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Introduction 


Let  {X^}  and  {B.},  i  -  0,1,2,...,  be  sequences  of  nonnegative 


random  variables  and  define  the  sequence  {D.}  by 


D  , ,  =  max 
n+1 


I 0,D   +  X   -  B  V  n=0,l,2,  ...      (1) 
\    n    n     n  / 


Equation  (1)  will  be  familiar  to  any  reader  who  has  studied  the 
single  channel  queue  with  FIFO  order  of  service.   If  X   is  the 

service  time  of  customer  n  and  B   is  the  time  between  arrivals 

n 

of  customers   n   and   n+1,   then,  if  customer   0   starts  a  busy 
period   (D~  =  0) ,   D    represents  the  delay  in  queue  of  customer 

n   (see,  for  example,  Kleinrock  [1975],  p.  278) 

The  purpose  of  this  paper  is  to  analyze  the  distribution  of  D 
for  a  class  of  correlations   between  {X.}  and  {B.}.   In  section  1 

we  give  a  number  of  examples,  including  a  budgeting  problem,  which 

can  be  modelled  by  equation  (1)  with  such  correlations.   This 

budgeting  problem  is  used  to  illustrate  our  analyses.   In  section  2 

we  analyze  the  case  B   =  X   ..  .   In  section  3  we  extend  our  results 
J  n     n-l 

to  the  case  where  B   is  a  convex  linear  combination  of  X   ,  through 

n  n-j. 

X  „    for  some  I    ^   1 .   In  section  4  we  interpret  our  result  for  the 

n-l 

G/G/l  queue,  and  in  section  5  we  suggest  areas  for  future  study. 


1 .   Examples 

Consider  a  budgeting  process  in  discrete  time,  where  demands 
for  funds  occur  over  time,  and  unused  funds  budgeted  in  a  given 


period  cannot  be  carried  forward,  but  where  unfilled  demands  are 

carried  forward.   Examples  of  such  budget  processes  occur  in 

government  agencies  operating  from  one  fiscal  year  to  the  next. 

If   X    is  the  demand  for  funds  in  period   n,   and   B    the  budget 
n  n         r 

allocated  to  period   n,   then   D   ,   is  the  budget  deficit  at  the 

start  of  period   n+1.   For  an  example  in  the  U.  S.  Navy  supply 
system,  see  Daeschner   [1975].   The  budgeting  problem  is  the  example 
that  we  pursue  in  this  paper.   However,  the  following  examples  also 
fit  the  same  structure  of  equation  (1) .   It  is  left  to  the  reader 
to  interpret  our  results  for  these  examples. 

Consider  a  job  shop  which  is  scheduled  in  discrete  time 
periods.   Let   X   be  the  demand  in  period   n   for  some  resource 

such  as  manhours.   Such  a  resource,  if  not  used  in  the  given  period, 
is  lost.   Let   B    be  the  amount  of  resource  allocated  by  a  planning 
process  for  period   n.   Although  unused  resources  like  manhours 
cannot  be  carried  forward  from  period  to  period,  unfilled  demands 
for  these  resources  must  eventually  be  satisfied.   Thus,  D    repre- 
sents the  work  backlog  at  the  start  of  period   n. 

Consider  now  a  reservoir  control  problem.   Let  the  water 
output  in  period   n   be   B    and  assume  that  the  input  to  the 

reservoir  in  period   n   is   X  .   Let   D    be  the  reservoir  content 

c  n         n 

at  the  start  of  period   n.   Then  the  sequence   j  D  J   satisfies 
equation  (1)   (assuming  infinite  reservoir  capacity) . 


Consider  next  a  periodic-review  inventory  process  with  a  single 

perishable  item.   Let   X    be  the  demand  in  period   n   and   B   the 

*  n  ^  n 

stock  which  arrives  in  period   n.   Let   D    be  the  amount  on  back- 
order  at  the  start  of  period   n.   Again  the  sequence   JD  | 
satisfies   (1) . 

Finally,  equation  (1)  can  be  given  the  following  queueing 
interpretation.   Consider  a  service  system  which  is  reviewed 
periodically.   Let   X    be  the  total  number  of  arrivals  in  period 

n   and   B   the  total  service  capacity  in  period   n.   Then   D  ,. 

represents  the  "queue"  at  the  start  of  period   n+1. 

Unlike  the  simple   GI/G/1  queue  discussed  in  the  intro- 
duction, in  the  above  examples   it  may  not  be  realistic  to  assume 
that  the  two  sequences  jX.J  and  Jb.J  are  independent  or  that 

each  is  a  sequence  of   iid   random  variables.   In  the  following 

sections  we  investigate  the  behavior  of   D    for  a  number  of 

n 

cases  where  the  two  sequences  are  correlated. 

We  end  this  section  with  a  well  known  result  (see,  for 
example,   Kleinrock  [1975],  p.  278),  that  if   U   =  X   -  B  , 

then 

Dn+1  =  Max(0,Un,Un  +  Un_1 Un  +  0n_1  +  ...  +  Oj  +  Uj   (2) 

Equation  (2)  which  is  equivalent  to  equation  (1)  will  be  important 
in  our  analyses. 
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2 .   Single  Period  Correlation 

In  this  and  later  sections  we  focus  on  the  budgeting 
example  discussed  earlier.   Let  the  sequence  of  demands  {X.} 

be   iid   random  variables  with  finite  first  moment   u   and 
distribution  function   F,  and  let  the  budget  allocated  to 
period   n   be  equal  to  the  demand  in  period   n-1.   Thus, 


B   =  X    ,       n  >  1.  (3) 

n    n-1 


Let  B   be  an  independent  random  variable  distributed  as 
X  .   From  (3)  and  the  definition  of   U   we  have, 

U   +U   ,+...+  U   .  =  X   -X     _  ,       i=0,l,...,n-l    (4) 
n     n-1  n-i    n    n-i-1 

and 

U   !-  U   ,  +  .  .  .  +  UA  =  X   -  Bn  . 

n     n-1  0     n     0 

Thus,  from  (2) 

D  _,.,  =  Max  (  O.X   -X   ,,X   -X   _,  ...,X   -  Xn,Xn  -  B.) 
n+l       \  '  n    n-1    n     n-2'       n     On     0/ 

which  can  be  rewritten  as 


Dn+1  =  Max(  0,Xn  -  Min  (X^^X^,..^^)). 


(5) 


Now,  let   m  =  inf {x | F (x) >0} .   Clearly,   m   is  the  minimum  demand 
that  could  occur  in  any  period.   If  we  let 

Y   =  Min  (X   ,  ,X   0, . .  . ,X.,B-)  , 
n  n-1   n-2     '    0   0 


then 


D  ._  =  Max(0,X   -  Y  )     and 
n+1  n     n 


(6) 


P[Yn  >  y] 


[1-F(y)]n  =  [F(y)]n, 


(7) 


where   F(y)  =  1  -  F(y) 


By  using  conditional  probability  arguments,  we  determine  the 
distribution  of   D      from  (6)  and  (7)  to  be 


P[D   .  <;  x]  =  F 
n+1 


F  ((u-x)~j  ndF(u)  , 


x  *  0.   (8) 


From  the  definition  of   m, 


F(x)n  -v  1   for  x  <  m  and   F(x)n  ■>  0   for   x  >  m. 

Thus  we  see  that  <  D  |  converges  in  distribution  to  a  random  variable, 
say  D,  with  distribution  function   D(x),  where 


D  (x)  =  F  (m  +  x)  , 


x  >  0. 


From  (8)  it  is  straight  forward  to  show  that 


E(D    )  =  M 


/*00 

-/  F(u)n+1du, 
J  0 


and  therefore, 


E  (D)  =  \i    -   m. 


(9) 


The  above  equations  show  that  the  budgeting  process  can  be 
operated  without  planned  surplus  resources,   i.e.   EfBn^    E^Xn^' 


and  deficits  remain  small  and  well  behaved.  In  the  language 
of  queues,  (9)  would  indicate  that  the  single  channel  queue 
can  be  operated  with  traffic  intensity 


E[B  1 

P=  2_  =  1 

E[Xn] 


and  with  finite  (indeed  small!)  waiting  times.   This  result  needs 
closer  scrutiny,  and  we  return  to  it  in  section  4. 

Let   i   be  the  index  of  a  period  with   D.  =  0  and  let 
K(>i)   be  the  first  succeeding  period  with  zero  deficit.   Now 
let   N  =  K  -  i+1 .    In  queueing  theory,   N  is  analogous  to  the 
number  of  customers  served  in  a  busy  period.   Now 


{N>n}  <=>{U1>0,U1  +  U2>0,  .  .  .  ,UX  +  U2  +  .  .  .  +  Un  >  0}  .  (10) 


Using  (3)  and  (4) ,   (10)  can  be  shown  to  be 


{N>n}  <=>  {X,>X  ,X~>X  ,...,X  >X  }. 
1   o   2   o      no 


Since  the  demands   {X  }   are  assumed  to  be   iid, 

n 


P(N>n)   =  /   F(u)ndF(u)  =   ^^       n  =  0,1,2,.,.    (11) 
^0 

independent  of  the  demand  distribution   F.  Thus,  although  the 

"busy  periods"  are  finite  with  probability  1,   they  have  an  infinite 


mean.   This  would  lead  us  to  believe  that  if   S    is  the  surplus 

n  c 

resource  at  the  end  of  period   n   (which  is  lost  at  the  beginnin< 
of  period   n  +  1) ,  then,  for  large  n,   S   would  be  zero  with 

probability  1.     We  now  show  this  to  be  the  case.   First,  note 
that 


S   =  Max  (  O'B   -  (D   +  X  )  )  . 

n        x         n     n     n  / 


Combining  this  equation  with  (1)  yields 


D  ,,  -  S   =  D   +X   -B 
n+1     n     n     n     n 


where   Dn+1sn  =  °-   Taking  expected  values  in  this  equation 


gives 


E[S  ]  =  0 
n 


Here  we  have  assumed   n   large  so  that   E[D  ,_]  =  E[D  ].   Since 

3  n+lJ       n 

S   is  a  non-negative  random  variable,  it  must  be  zero  with 

n  3 

probability  1. 


3 .   Multiperiod  Correlation. 

In  this  section  we  extend  the  results  in  section  2  by 
letting  the  budget  in  period   n   be  a  function  of  the  demands  in 
periods   n-1,  n-2,  . . . , (n-l)       for  some  fixed  integer  I.      Specif i- 


ca 


lly,  let   a  .  s  0   and   £-.a.  =  lf  and  let 


I 

B    =   7  a .X   .  .       n  =  0,l  ,2 ,  .  .  .  (12) 

n     .Sin-i 
i  =  l 


For   n  <  I,   we  require  the  introduction  of  the  additional  random 


variables   x_n^x_2' 


. ,X  „   so  that   B    will  be  well-defined. 

-I  n 


|    oo 

As  with    X .  .  Q    we  assume  that    X_, ,  X_? , . . . ,  X     is 

a  set  of  iid   random  variables  with  distribution  function   F. 
Note  that   ja.|£a.  =  l,a.  ^  g}   contains  the  3  special  cases  : 


a)  az   =  1,   ai  =  0    for   i  <  I  , 


b)   ai  =  \/l 


i  £  I  , 


q2-    1(l-a) 


c)       a .  = 

i 


,   0  <  c(  <    1, 


i  <.   I 


(1  -  a 


I) 


Case   b)   gives  the  arithmetic  average  and  case   c)   gives 
B   as  a  truncated  exponentially  weighted  average  of  the  past 

demands   (see,  for  example,   Brown  [1959]).   The  model  in  section 
2  is  the  case   a)  with  I   =    1 .   In  all  cases  given  by   (12),  B 

is  an  unbiased  estimate  of   y  ,  the  expected  demand  in  a  period. 


A  key  to  our  analysis  in  this  section  is  the  following 
Lemma:   For  fixed  I    >    1 f  let  the  budget    B    be  given  by  (12), 


£ 


and  let  A 


i-  J. 


D=i 


a  .  . 


If  we  define 


V   =  I    A.X   .  . 
n        i  n-i+1 
1=1 


n  =  -1 , 0  , 1 ,  .  .  .  > 


(13) 


8 


Therefore , 


n+1 


=  P 


V   -  M   >  x 
n     n 


>  P 


V   -  M.  .    .  >  x 
,  n    k(n) 


But   V   and  M  ,     are  independent  and 


n 


k(n) 


P  M.  ,  ,  >  x 
L  k  (n) 


V(x) 


k(n) 


Thus 


D   n  >  x 

n+1 


>    f[l    -(V(u^x)-)k(n)]dV(n) 


(16) 


Combining  (15)  and  (16)  gives 


/oo 
V(u-x)k(n)dV(u) 


^  p 


Dn+]_  >  x  |  ^  Vlx  +  m(A,£) 


(17) 


As   n  +   oo,  V(u)k(n)  ->  1   for   0  <;  u  <;  m(A,£) 


->  0   for   m(A,£)  < 


Thus 


/ 


V(u-x)k(n)dV(u) 


->  V  x  +  m(A,£)   -  V(x)  =  V(x)  -  V  x  +  m  ( 


:a,jo) 


X 


When  this  result  is  used  in  (17)  ,  we  have  that 


Dn+1  >  X 


■*   V  x  +  m(A,l) 


11 


By  integration  over   x   in   (17) ,  it  is  straight  forward 
to  show  that 


v  -  f    V(u)k(n)+1du 


^  E 


D 


n  +  1 


0 


/ 


V(u)du, 
m(A,£) 


(18) 


whe 


re    v  =  E|V    =  y  )   A.  . 
L  nJ      n   i 
l-l 


Taking  the  limit  in   (18) ,  we  see  that 


D 


n+1 


(y  -  m)  I      A.  . 
i=l   1 


(19) 


Notice  that,  as  in  section  2,  the  deficits  remain  bounded  without 


planned  surplus  resources   [i.e.,   E  B  1  =  E 


X 

L  n 


Now  we  look  at  the  random  variable   N,   and  note  that  (10) 

still  holds.   Using  the  result  in  the  proof  of  the  lemma  that 

U   =  V   -  V   .  , 
n    n    n-1 


{N  >  n}  <  =  >  jV1  >  VQ,  V2  >  VQ Vn  >  V  | 


Now 


|v1  >  v0,v2  >  v0 vn  >  v0(   =>.jv£  >  v0,v2i,  >  v0 vk(n)£  >VQJ, 


where  again   k(n)  = 


n 


UJ 


,  and  for   n  <  £   the  event  on  the  right 


hand  side  is  taken  to  be  the  certain  event.  Then  it  is  easy  to 


show  that 


N  >  n 


k(n)+l 


12 


Of  course  this  does  not  show  that   E 


r  -> 
N 


is  finite.   By  defining 


Sn  to  be  the  surplus  resource  at  the  end  of  period   nf  and  using 


the  same  method  as  in  section  1, 


S 

n 


=  0   for  large   n.   Thus 


j 


"busy  periods"  never  end  with  probability  1,  and  hence   e[n]  is 
in  fact  infinite. 

We  now  look  at  some  specific  examples  of  the  budget  policy 
given  in  (12).   First,  let   ai  =  0   for   i  =  1,  2,...,£-l,  and 

a^  =  1.   Thus,    B   =  X  _.,  which  sets  the  budget  in  period   n 

equal  to  the  demand  in  period  n  -  I .  Then   A.  =1   for 

I 
i  =  1,  2,  ...,l      and    £   A.  =  I.       Then   D(x)  =  F  (x  +  mil),   and 

i=l   1 

D   =  (y  -  m)&  .   Thus,  if  we  considered  a  sequence  of  policies 
with  parameter  I      we  see  that  the  equilibrium  deficits  stochastically 
increase  linearly  with  I.      We  conclude  that  if  such  a  budget 
policy  is  to  be  used,  it  is  best  to  use  the  demand  for  the  most 
recent  period  for  which  information  is  available.   Notice  that  if 
the  demand  is  not  deterministic,  then  \i    -   m  >  0  .    One  can  think 
of  the  budgets  and  demands  being  less  dependent  as  I      increases. 
Note  that  as   &•>«>'   our  result  is  consistent  with  that  of  the 


GI/G/1   queue  with   P  =  1,   namely  that   E 
large. 


D 


become  infinitely 


Suppose  that  we  interpret  equation   (12)   to  be  an  attempt 
to  forecast  the  demand  in  period   n   from  data  on  past  demands. 
Having  obtained  a  forecast,  one  would  then  allocate  matching  re- 
sources.  The  best  (or  BLUE)  estimator   of  the  expected  demand 

13 


is  obtained  by  setting   a.  =  1/&,  i   -•    I ,    in  equation   (12)   and 

using  I    large  (recall  our  demands  are  stationary) -   But  if  the 
objective  is  to  minimize  deficits,  we  see  from  (19)  that  the 
optimal  weights  in  (12)  are   a   =  1,  a.  =0,  i  >  1.   These 
weights  minimize  both  the  expected  deficit  and  the  variance  of 
the  deficit.   In  fact,  the  reader  can  verify  that  the  deficit 
with  I   =   1  is  stochastically  smaller  than  any  other  case  which 
satisfies   (12) . 

4 .   Interpretation  in  the  Standard  Queueing  Model 

The  budget  policies  defined  by   (12)   are  physically 
realizeable  when  n   in  (12)  indexes  discrete  time  periods.   In 

such  cases,  it  is  possible  to  know  X  Q      for  some  positive  I 

n — jo 

in  time  to  set  the  budget  for  period   n.   In  the  case  of  the 
single  channel  queue  where   n   indexes  the  customers  in  order  of 
arrival  and  service,  a  policy  of   B   =  X   .   would  imply  that 

arrivals  could  be  scheduled,  and  that  the  interarrival  time 
between  customers   n   and   n  +  1,  B^ ,    should  be  set  equal  to 

the  service  time  of  customer  n-i,      namely   xn_o/   with  1   =   1 

leading  to  the  shortest  delays  in  queue. 

For  simplicity,  let  m  =  0.   Then  from   (14)  Dn4.1  =  vn 
with  probability  1  in  steady  state.     Now,  if   Bn  =  xn_£/   tnen 

D   .,=X   +  X   ,  +  ...+  X   „  , ,  .   The  situation  is  drawn  in 
n+1    n    n-1  n-ic+1 

fijure  1  for  1=3      and  the  queue  in  steady  state.   Note  that 
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Bn   and   *n_3  occur  simultaneously.   Clearly,  such  a  situation 

cannot  be  realized  unless  the  service  time   X   _   is  known  bv 

n-3  7 

the  time  customer   n-3   starts  service.   When  this  is  the  case, 

customer   n+1   is  scheduled  to  arrive  at  the  completion  of  service 

of   n-3.   Thus,  there  are  always  exactly   3   customers  in  the 

system. 
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Figure  1:   Steady  State  Realization  with 

I   =  3 ,  a  ->  =  1 ,  m  =  0 . 


5 .   Conclusions  and   Suggestions  for  Future  Work. 

In  this  paper  we  have  identified  applications  of  the 
"waiting  time"  random  variable  outside  the  standard  applications 
in  queueing  theory  and  have  illustrated  them  by  examples  in 
budgeting.   To  make  the  applications  realistic,  we  allowed  the 
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"service  times"  and  "inter-arrival  times"  to  be  correlated.   For 

a  simple  class  of  correlation  relationships  we  determined  the 

distribution  (or  bounds  on  the  distribution)  for  the  "waiting 

times"  and  for  the  "busy  period"  and  we  showed  that  the  process 

with  traffic  intensity  of  unity  (no  excess  budget)  can  operate 

1)  with  small  waiting  "times"  (deficits) ,  2)  without  planned 

"idle  times"  (surplus  funds) ,  and  3)  with  infinitely  long  expected 

"busy  periods."   We  also  show,  where   B    is  an  unbiased  linear 

n 

estimate  of   y ,  that  it  is  optimal  to  select    a,  =  1,  i.e., 

B   =  X   ,  ,    in  order  to  minimize  both  the  expected  value  and 

n     n-i  c 

the  variance  of  the  "waiting  times." 

Because  of  the  plethora  of  results  for  the  single-channel 

queue  with  independent  service  and  interarrival  times,  our  results 

may  surprise  many  of  our  readers.   Certainly,  most  were  initially 

non-intuitive  to  the  authors.   We  see  from  these  results  some  of 

the  consequences  of  the  assumption  of  independence  of  the  sequences 

iB     and   X  <  .  In  particular,  we  see  that  some  forms  of  correlatior 
1  n )        (n1 

between  the  two  sequences  enable  one  to  schedule  resource  utiliza- 
tion very  efficiently. 

One  can  postulate  more  complex  interrelations  both 
between  and  within  the  sequences  }x  }  and  j  B  J.   For  example, 
demands  may  not  be   iid   random  variables.   They  may  be  independ- 
ent but  growing,  or  they  may  be  serially  correlated.   There  is 


much  evidence   (see  ,  for  example,  Capra 


r 


1974  and  Gaver  11975 


that  in  governmental  budgeting  the  appropriation  of  funds  depends 
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on  previous  appropriations  as  well  as  demands  and  deficits. 
Although  some  statistical  work  has  been  carried  out  to  demonstrate 
"within-sequence"  correlations,  the  authors  believe  that  there 
is  much  work  to  be  done  in  analyzing  the  effects  of  such  corre- 
lated budgeting  policies  on  deficits  and  surpluses. 
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